Rust Job: Senior Software Development Engineer II

Travelport’s Big Data Engineers are tasked with developing systems that realizes the business value of the Data Science ML/AI models. Travelport has Big Data and sophisticated Big Data Platforms in the cloud and on premise. We have Big Data, processing Terabytes or Petabytes of data, some systems processing billions of transactions per day, and some applications processing 100+k transactions per second. This role will create and lead the creation of frameworks and architectures for system integration, data pipelines, model generation pipelines, and more. They also lead the development of streaming and batch data products. Travelport employees enjoy a collaborative environment and have many opportunities to learn from and share knowledge with other Travelport subject matter experts, architects, and business leaders.

Duties:

• Design and build innovative platforms, frameworks, and tools to support all phases of delivering Data Value
• Aid in the implementation of AI/ML Models
• Design and build scalable, fault tolerant, observable data pipelines and services using tools like Kubernetes EKS, Prometeus, Grafana, etc
• Lead in systems optimization of streaming products, analytic platforms, and processing workflows
• Develop high performance, high volume, and saleable solutions utilizing various Cloud Managed Services, Kubernetes, In Memory Caching, Advance Algorithms, Treading, etc
• Lead the design, implementation, and optimization of Data Infrastructure (Cassandra, DynamoDB, Pinot, Aurora, etc)
  

Main Accountabilities:

• Lead, architect, design, develop, document, and test big data solutions
• Install, integrate, and configure various technologies in the big data echo system
• Troubleshoot issues in big data framework
• Collaborate with business and technical teams to deliver software
• Learn continuously, leverage training resources and self-directed training, share knowledge and skills with others
• Provide mentoring and leadership to more junior resources
• Passion for technology and willingness to learn is required
• Lead a team to deliver a quality deliverable
• Candid and direct communication
• Creative thinker who can bring in new ideas and innovations to the company
  

Required Qualifications:

• 8+ years large scale enterprise development
• On Premise and/or Cloud Big Data Experience
• Advance development experience (Java, Scala, Python, Rust, or C/C++)
• Produce high-quality, maintainable software
• Knowledge of multiple threaded development
• Knowledge of one or more Big Data Technologies like Kubernetes, Aurora, DynamoDB, Elastic Search, Spark, Kafka, Hive, S3,
• Knowledge of workflow orchestration tools like Airflow, Argo, Kubeflow, etc
• Knowledge in Cloud Patterns, Design Patterns, Distributed Patterns
• Knowledge of how to diagnose performance problems and tools used to monitor and tune performance (Performance best practices per the technology, Cloud Watch, Prometheus, Grafana)
• Bachelors/Master/PHD in Computer Science, Engineering, Information Technology, or related degree and/or equivalent work experience
  

Preferred Qualifications:

• Development experience in the field of big data on a TB or PB Scale environment (e.g. S3, Hadoop, Alluxio, DynamoDB, Cassandra, Pinot, Red Sift, Redis)
• Spark Based Technologies (e.g. Spark Dataframes, Spark Streaming and Spark SQL)
• Aid in the modeling and implementation of machine learning and deep learning solutions
• Real time analytics using stream processing frameworks such like Spark, Flink, ksqlDB
• Knowledge of designing and developing reusable components
• Web service protocols such as REST